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I. INTRODUCTION 

This Appeal was initially commenced by a Notice of Appeal (filed on November 19, 
2003) and an Appeal Brief (filed on March 17, 2004), in response to a Final Office Action (Paper 
No. 18) (hereinafter, the "FINAL ACTION,) finally rejecting claims 1-22 of the above-identified 
application. In response to the Appeal Brief, a new Final Office Action was mailed on June 2 1 , 
2004 (Paper No. 23) (hereinafter, the "NEW ACTION") to re-open prosecution and assert new 
grounds of rejection. Appellants reinstated the Appeal pursuant to 37 C.F.R. 1 .193 (b)(2) with a 
Supplemental Appeal Brief (mailed on November 22, 2004) to address the newly asserted 
grounds for rejection. This new Appeal Brief is being submitted in response to a Notification of 
Non-Compliant Appeal Brief, mailed on May 4, 2005, to proceed with the Appeal. 

II. REAL PARTY IN INTEREST 

The real party in interest for the above-identified application is International Business 
Machines (IBM) Corporation, the assignee of the entire right, title and interest in to the subject 
application by virtue of an assignment of record in the U.S. Patent and Trademark Office. 

III. RELATED APPEALS AND INTERFERENCES 

There are no Appeals or Interferences known to Applicant, Applicant's representatives or 
the Assignee, which would directly affect of be indirectly affected by or have a bearing on the 
Board's decision in the pending Appeal. 

IV. STATUS OF CLAIMS 

Claims 1-22 are pending. Claims 1 and 4-22 stand rejected and are under appeal. Claims 
2 and 3 stand are objected to as being dependant on a rejected base claim but would be allowable 
if rewritten as suggested on Page 9 of the NEW ACTION. The currently pending claims, 
including those claims on appeal, are set forth in the Claims Appendix. Claims 1, 13, and 18 are 
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independent claims. Claims 2-12 depend directly or indirectly from claim 1 . Claims 14-17 and 
21 depend directly or indirectly from claim 13. Claims 19-20 and 22 depend directly or 
indirectly from claim 18. 

V. STATUS OF AMENDMENTS 

No after final Amendments were filed in this case subsequent to the NEW ACTION. 

VI. SUMMARY OF CLAIMED SUBJECT MATTER 

In general, the claimed inventions include systems and methods that use watermarking 
techniques for verifying the authenticity of digital images, wherein one or more camera/image 
parameter(s) are automatically recorded and watermarked within a captured image. The 
watermarking process includes invisibly watermarking (i.e., hiding) one or more of the recorded 
parameters within the captured image. The parameters may include, for example, names of 
geographic locations, altitude, longitude, time, date, photographer identification, object 
identification, as well as image data such as light intensity, shutter speed and flash status, etc. 

The recorded/watermarked parameters are used for verifying the authenticity of the 
captured image. More specifically, the authenticity of a digital image can be verified by 
extracting watermarked parameters from the digital image, and comparing the extracted 
parameters with original recorded parameters that are associated with the digital image to 
determine whether the recorded parameters match the extracted parameters. Since the recorded 
parameters are watermarked into the image, it is difficult to modify the image without affecting 
the watermarked data. Therefore, if the extracted data appears corrupted (the extracted 
parameters do not match the recorded parameters associated with the image), it is an indication 
that the image is not authentic and has been modified or otherwise tampered with. 
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Independent Claims 1, 13 and 18 are representative of claimed subject matter that 
embodies features of the invention as generally described above. For illustrative purposes, the 
claimed subject matter will be described with reference to exemplary embodiments described in 
Appellants Specification (hereinafter, the " Spec ") and accompanying Figures, although nothing 
herein should be construed as unduly limiting the scope of the claimed subject matter. For each 
Claim listed below, the claim elements are presented in italicized text, and are followed by 
citation to exemplary figures and/or supporting text in the current specification. 
Claim 1; 

An image capturing system for automatically recording and watermarking a 
plurality of parameters in a captured image, (see, generally, e.g., FIG. 1, Sgec. pp. 
7-13), comprising: 

a central processing unit for controlling a plurality of functions and operations of 
said system (see, e.g., FIG. 1, element 102; Spec. p. 7, line 19 - p. 8, line 15); 

image capture means operatively connected to said central processing unit, for 
generating a digital image of an observed image frame and for generating a plurality of 
image data associated with said generation of said image (see generally, Spec, p. 7, 
lines 6-18); 

wireless communication means, operatively connected to said central processing 
unit, for receiving object data from objects in said observed image frame when said 
image is generated, said object data comprising object identification information (see, 
e.g., FIG. 1, elements (112), (116), (118), (120); Spec. , p. 9, line 23 - p. 10, line 6 ); 

The wireless communication means may be a radio frequency (RF) processor (112) for 
processing incoming RF signals and transmitting RF information, via an RF port (116). The 
wireless communication means may be an infrared (IR) processor (118) for processing incoming 
optical information and for transmitting optical signals via IR port (120). The IR processor (1 1 8) 
and/or RF processor (1 12) may be utilized for communicating with objects in a scene being 
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photographed (assuming the objects being photographed are transmitting either RF or IR signals) 
so as to obtain and record information such as the name and identity of the object. 

geographic location determining means, operatively connected to said central 
processing unit, for determining geographic coordinates of said system when said digital 
image is generated; (see, e.g., FIG. 1 element (114); Spec, p. 8, line 20 - p. 9, line 2) 

means for determining a time and a date when said image is generated; (see, e.g., 
FIG. 1, element (114); Spec, p. 8, lines 23-24) 

information receiving means, operatively coupled to said central processing unit , 
for receiving user data associated with a user or said system when said digital image is 
generated, said user date comprising user identification information; (see, e.g., FIG. 1, 
elements 110, 142, 122, 124; Spec , p. 9, lines 4-22) 

As depicted in FIG.l, the information receiving means may be a smartcard reader/writer 
(110) for reading and writing information to and from various cards, e.g., magnetic cards, IC 
cards and/or EAROM cards (142). The smart card reader/writer (1 10) may be utilized for 
obtaining additional recordable parameters such as the identity of the photographer, which can 
be subsequently utilized for verifying the authenticity of the images. In another embodiment, the 
information receiving means may be a Personal Area Network (PAN) receiver (122) for 
obtaining recordable information such as the identity of the photographer upon human contact 
(e.g., holding the camera) when an image is taken. (See, e.g.. Spec , p. 9, lines 4-22). 

image processing means for receiving said plurality of parameters and recording 
said plurality of parameters with said generated digital image, said plurality of 
parameters including said plurality of image data, said object data, said time data, said 
date data, said location data, and said user data; and (see, e.g., FIG. 1, element (106); 
Spec, p 10, lines 7-10). 

As depicted in FIG. 1, the image processing means (106) for receiving the plurality of 
parameters and recording the plurality of parameters with the generated digital image. The 
plurality of parameters include, e.g., the image data, object data, user data, etc. For example, the 
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parameters generated with the digital image are provided to the image/parameter processor (106) 

wherein they are recorded onto the digital image. These parameters are preferably recorded in a 

header file associated with the digital image. (Spec, p 10, lines 7-10). 

means, operatively coupled to said image processing means, for watermarking 
said plurality of parameters into said image. (See, generally. Spec, p. 11, line 10 - p. 14, 
line 10; FIG. 1, element (134); FIG. 2, elements (200, 202, 204); FIG. 5, elements 
(511,510, 204). 

FIG. 1 depicts a watermarker processor (134) for watermarking a plurality of parameters 
into a source image. The image/parameter processor (106) provides the watermarker processor 
(134) the source image and parameters to be watermarked into the source image (See, e.g.. 
Spec. p. 11, line 10 - p. 12, line 5.). As depicted in FIG. 2, the watermarker processor (134) 
comprises an image stamping module (204) which receives the source image (200) and stamping 
information (202) (parameters) to be watermarked into the source image (202). FIG. 5 depicts 
an exemplary embodiment of the image stamping module (204) of Fig. 2 for embedding the 
stamping information into the source image. 
Claim 4; 

The system of claim 1, further comprising means for extracting said watermarked 
parameters from said watermarked image. (See, e.g., FIG. 1, element (134) FIG. 2, elements 
(212, 214); Spec. p. 14, line 28 - p. 15, line 5.) 

The watermarker processor (134) includes a stamping information extractor (214) for 
receiving a stamped image and a corresponding verification key of the stamped image from a 
secured storage of verification keys (212). The stamped source image and corresponding 
verification key are processed by the stamping information extractor module (214) wherein the 
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stamping information embedded on the retrieved stamped image is extracted. (Spec, p. 14, line 
28 -p. 15, lines.) 
Claim 5: 

The system of claim 4, further comprising means for comparing said 
extracted parameters with corresponding recorded parameters of said image to 
authenticate said image. (See, e.g., FIG. 1 element (134); FIG. 2 element (218); 
Spec. p. 15, lines 5 - 16) 

The watermarker processor (134) comprises a comparator (218) for comparing extracted 
parameters (216) with corresponding recorded parameters (202) of a given source image (200) to 
authenticate the image. 
Claim 6: 

The system of claim 1, further comprising means for preventing said 
watermarking of said images if an image quality of said image is altered above a 
threshold (See, e.g., FIGs. 2 and 5, elements (204) and (504, 505, 508); Spec, 
p. 14, lines 3-6, p. 18, line 23 - p. 20, line 21). 

The watermarking process is implemented such that there are no visible artifacts in the 
watermarked images and that the stamping information is hidden invisibly in the original image. 
Claim 13: 

In an image capturing system, a method for authenticating a captured 
image, comprising the steps of (See generally, FIG. 3, Spec, p. 15, line 17 - p. 
17, line 10) 

measuring a plurality of parameters associated with said captured image; 
(see, e.g., FIG. 3, step 304) 

watermarking said plurality of parameters into said captured image to 
generate a watermarked image, and generating a verification key associated with 
said watermarked parameters; (see, e.g., FIG. 3, step 306) 

extracting said plurality of parameters from said watermarked image with 
said associated verification key; and (see, e.g., FIG. 3, steps 312, 314) 

comparing said extracted plurality of parameters from said watermarked 
image with said measured plurality of parameters associated with said captured 
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image, whereby said captured image is authenticated if said extracted parameters 
match with said measured parameters, (see, e.g., FIG. 3, steps 314, 316, 318 and 
320). 



Claim 14: 

The method of claim 13, further comprising the step of recording said measured 
plurality of parameters associated with each captured image, said extracted 
parameters being compared with said recorded parameters to authenticate said 
captured image, (see, e.g., FIG. 3, steps 304 and 316) 



Claim 21; 

The method of claim 13, wherein the step of measuring a plurality of 
parameters associated with said captured image comprises receiving and 
recording object data from an object in an observed image frame when the image 
is generated, said object data comprising object identification information, (see, 
e.g., FIG. 3, steps 304). 



Claim 18: 

A method for verifying the authenticity of a captured image, said captured 
image being generated by an image capturing system having means for 
measuring a plurality of parameters associated with said captured image and 
means for watermarking said plurality of parameters within said captured image, 
said method comprising the steps of : (See generally, FIGs. 1 and 3; and 
corresponding Spec, as above) 

specifying at least one of said plurality of parameters to be measured and 
watermarked by said image capturing system; (See e. g., FIG 1, element (126) 
and FIG. 3, steps 300 and 302) 

capturing an image of a desired object with said image capturing system; 
(See e.g., FIG 3, step 304) 

watermarking said captured image of said object with said specified 
parameters; (See, e.g., FIG. 3 step 306) 

generating a corresponding verification key based on said watermarked 
parameters; (See e.g., FIG. 3, step 306) 

storing said watermarked image and said corresponding verification key; 
(See, e.g., FIG. 3, step 308) 
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retrieving said watermarked image and said corresponding verification 
key; (See, e.g., FIG. 3, steps 310 and 312) 

extracting fi-om said watermarked image said watermarked parameters 
using said verification key; (See e.g., FIG. 3, step 314) 

comparing said extracted parameters with said specified parameters to 
determine if said extracted parameters match said specified parameters. (See 
e.g., FIG. 3 step 318) 



Claim 19: 

The method of claim 18, further comprising the step of recording said 
specified parameters, wherein said recorded parameters are compared with said 
extracted parameters. . (see, e.g., FIG. 3, steps 304 and 316) 



Claim 22; 

The method of claim 18, wherein said plurality of parameters to be 
measured and watermarked comprises user data that is automatically transmitted 
from a user and recorded when said image is captured, said user data comprising 
user identification information, (see, e.g., FIG. 3, step 304). 



VII. ISSUES TO BE REVIEWED ON APPEAL 

A. Claims 1, 4-8 and 12-22 stand rejected under 35 U.S.C. § 103(a) as being 
unpatentable over U.S. Patent No. 5,499,294 to Friedman in view of U.S. Patent No. 6,192,138 
to Yamadaii . 

B. Claim 9 stands rejected under 35 U.S.C. §103(a) as being unpatentable over 
Friedman in view of Yamadaii in further view of U.S. Patent No. 5,799,082 to Murphy et al. 

C. Claims 10-1 1 stand rejected under 35 U.S.C. §103(a) as being unpatentable over 
Friedman in view of Yamadaii in further view of U.S. Patent No. 5,335,072 to Tanaka et al. 
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VIIL ARGUMENTS 

A. The Combination of Friedman and Yamadaji is Legally Deficient to 

Support a Prima Facie Case of Obviousness Against Claims 1. 4-8 and 12-22 

In rejecting claims under 35 U.S.C. §103, the Examiner bears the initial burden of 
presenting a prima facie case of obviousness. In re Riickaert , 9 F. 3d 1531, 1532 (Fed. Cir. 
1993). The burden of presenting a prima facie case of obviousness is only satisfied by showing 
some objective teaching in the prior art or that knowledge generally available to one of ordinary 
skill in the art would lead that individual to combine the relevant teachings of the references. In 
re Fine , 837 F.2d 1071, 1074 (Fed. Cir. 1988). A prima facie case of obviousness is estabUshed 
when the teachings of the prior art itself would appear to have suggested the claimed subject 
matter to one of ordinary skill in the art. In re Bell 991 F.2d 781, 782 (Fed. Cir. 1993). The 
suggestion to combine the references should come from the prior art, and the Examiner cannot 
use hindsight gleaned from the invention itself to pick and choose among related disclosures in 
the prior art to arrive at the claimed invention. In re Fine . 837 F.2d at 1075. If the Examiner 
fails to establish a prima facie case, the rejection is improper and must be overturned. In re 
Riickaert, 9F.3d at 1532 (citing In re Fine , 837 F.2d at 1074). 

In the case at bar, Appellants contend that the NEW ACTION fails, on various levels, to 
present a prima facie case of obviousness against claims 1, 4-8 and 12-22 based on the 
combination of Friedman and Yamadaji . For instance. Appellants contend that there is no 
legally sufficient basis or motivation for the Examiner's proposed modification of Friedman with 
the teachings of Yamadaji to support the obviousness rejections. In fact. Appellants will show 
that at the very least, the motivation and suggestion relied on by the Examiner for combining 
Friedman and Yamadaji is based on impermissible hindsight reasoning in view of Appellants' 
disclosure. 
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Furthermore, even assuming, arguendo, that Friedman of Yamadaii are deemed legally 
combinable, Appellants will demonstrate that the combination of Friedman and Yamadaji does 
not disclose or fairly suggest various elements of claims 1, 13 or 18. In fact, as explained below, 
the obviousness rejections are based, in part, on glaringly strained, unreasonable interpretations 
of the cited art in an attempt to fit claim elements to unrelated teachings of Friedman and/or 
Yamadaii . In other instances, obviousness rejections fail to address, and simply ignore, various 
claim elements. 

The obviousness rejections of Claims 1, 13 and 18 as set forth in the NEW ACTION are 
based primarily on the teachings of Friedman as modified by the teachings of Yamadaji. The 
following discussion will begin with a brief description of Friedman and Yamadaii. followed by 
an explanation as to the impropriety of the obviousness rejections based on the combination of 
Friedman and Yamadaii . 

Friedman - Image Authentication based on Digital Signature Protocol 

In general, Friedman is directed to a digital camera having a processing architecture that 
enables authentication of a digital image using a "digital signature" scheme based on "public key 
encryption" , which is well known in the art. In particular, Friedman discloses a camera having a 
processor that is equipped (by the manufacture) with an embedded "private key" that is unique to 
the camera. The camera processor includes means for computing an "image hash" of an image 
file (using a predetermined hash function) and means for encrypting the "image hash" using the 
"private key" to thereby generate a "digital signature" (i.e., the digital signature is the encrypted 
image hash). The image file and corresponding digital signature are separate entities that are 
stored in association together, and the digital signature is subsequently used for authenticating 
the corresponding image file as being free of alteration or modification. 
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In particular, with the Friedman system, authentication of the image file includes: (i) 
accessing the store image file and corresponding digital signature, (ii) computing an "image 
hash" of the accessed image file using the same predetermined hash function that was used to 
generate the original image hash; (iii) decrypting the corresponding digital signature using a 
"public key" to recover the original image hash (i.e., the secure image hash); and (iv) comparing 
the original (secure) image hash with the currently computed image hash of the accessed image 
file. If the original (secure) image hash matches the currently computed image hash, the 
accessed image file is deemed authentic (see generally, e.g., Friedman Abstract; Col. 4, lines 
19-54; Col. 5, line 49, through Col. 6, line 52; FIGs. 3A~3C; and Claim 1 (Col. 11, lines 21- 
37)). 

Friedman further discloses certain information (e.g., date, time, ect.) may be added in a 
border region of an image file, which surrounds the digital image, and that the added information 
in the border region is included in the image file which is hashed and encrypted to generate a 
digital signature (see generally, e.g., Friedman FIG 4; Col. 4, lines 55-66). Although 
Friedman discloses that such parameters in the image border are part of the image file that is 
hashed and encrypted to generate a digital signature, these border parameters are not necessary 
for the authentication because a digital signature is generated bv encrypting the image hash of an 
image file irresoectiye of whether or not the image border contains recor ded parameters. In other 
words, as explained above, the authentication is not based on the content of the image file, per 
se, but only on matching the secure image hash (obtained from decrypting the digital signature) 
and the computed image hash (obtained by hashing the image file in question) (see, e.g., 
Friedman Col. 5, line 49, through Col. 6, line 52). 
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Yamadaii - Copyright Protection Protocol using Watermarking 

Yamadaii discloses a method for watermarking copyright information (images or textual) 
in an image for purposes of copyright protection of the image. The copyright data is stored in 
memory as a digital watermark and the digital watermark can be accessed and embedded within 
a captured image (see, e.g., Col. 8, line 12- Col. 9, line 22). 

(1) Claims 1. 13 and 18 are Not Obvious in View of F riedman and Yamadaii 
The obviousness of rejections of Claims 1, 13 and 18 as set forth in the NEW ACTION 
are based primarily on the teachings of Friedman as modified by the teachings of Yamadaii. In 
formulating the obviousness rejections of claims 1, 13 and 18, the Examiner presents an obvious 
analysis for Claim 1, and relies on the same analysis for rejecting claims 13 and 18. (see, NEW 
ACTION, pp. 3-5). Therefore, Appellants will address the rejection of claims 1, 13 and 18 
together. 

(a) The Motivation for Combining Friedman and Yamadaii 
is Based on Impermissible Hinds ight Reasoning 

The obviousness rejections of claims 1, 13 and 18 are based, in part, on the Examiner's 

finding of motivation to combine Friedman and Yamadaii based essentially on Friedman's 

teachings of "recorded parameters" as modified by Yamadaii' s teachings of "watermarking" to 

conclude that it would be obvious to provide image authentication by watermarking a plurality 

of parameters into a captured image, as essentially claimed in claims 1, 13 and 18. In 

particular, the Examiner's obviousness analysis as set forth on pp. 4-5 of the NEW Action, is 

summarized as follows. 

The Examiner finds that Friedman 's method of digital image authentication is based on a 
public/private key and digital signature framework, and that recorded "parameter data" can be 
recorded in the border of the image. The Examiner finds that the "parameter data" in the border 
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of the image can be hashed and encrypted together with the image to generate a digital signature. 
The Examiner aclcnowledges that Friedman does noLexpressly disclose means for watermarking 

the parameters into the image. 

In an effort to cure the deficiencies of Friedman in this regard, the Examiner relies on 

Yamadaii 's disclosure of watermark textual data into an image, wherein the watermark data 

comprises a logo mark or trademark (see page 5 of the NEW ACTION). Based on these 

findings, the Examiner concludes that: 

It would have been obvious to one of ordinary skill in the art at the time of the 
invention was made to watermark Friedman's parameters into the image as well 
as record them. One would have been motivated to do so in an effort to safeguard 
the images against malicious manipulations while also protecting the proprietary 
rights by maintaining the integrity of the image content. 

It is respectfully submitted, however, that Examiner's finding of obviousness based on 
Friedman as modified by Yamadaii is merely conclusory and falls woefully short of that which is 
required to meet the burden of establishing that "[i]t would have been obvious to one of ordinary 
skill in the art at the time of the invention was made to watermark Friedman's parameters into 
the image as well as record them, based on the teachings of Friedman as modified by Yamadaii, 
as contended by the Examiner. 

In contrast, Appellants contend that the Examiner's obviousness analysis is based on 
hindsight reasoning in view of Appellants teaching of watermarking of recorded parameters for 
digital image authentication as the basis for combining the "watermarking" teachings of 
Yamadaii with the "recorded parameters" teachings of Friedman to derive inventions of claims 1, 
13 and 18. 
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In particular, the Examiner's reliance on Y amadaii's watermarking to cure the 
deficiencies of Friedman is misplaced. Indeed, on 2i fundamental level, it appears that Examiner 
reliance on Yamadaji , and rationale for modifying Friedman with Yamadaji, is erroneously based 
on Examiner's misinterpretation or misunderstanding of Yamadaji . Examiner contends that 
Yamadaji ''teaches watermarking an image to ensure that the content of the image has not be 
altered using an image verification process'' (See, e.g., NEW ACTION, bottom of p. 5). This 
misinterpretation of Yamadaji forms the basis of Examiner's conclusion of obviousness as 
outlined above, wherein the Examiner cites the ''motivation'' for using Yamadaji's watermarking 
in the Friedman system as " ... also protecting the proprietary rights by maintaining the integrity 
of the image content. " 

However, there is nothing in Yamadaji that teaches using watermarking for protecting 
against image alteration for purposes of image authentication. In contrast, although Yamadaji 
discloses "watermarking" in general, the express motivation behind Yamadaji's watermarking is 
to provide copyright protection (see, e.g., Yamadaji Abstract). In particular, as noted above, 
Yamadaji discloses the use of watermarking technology to embed copyright owner to confirm if 
a digital image has been "copied" by unbedding the digital watermark from the copy of the 
image data according to a prescribed procedure (see. Col. 2, lines 43-58). In other words, 
Yamadaji teaches the use of watermarking for the purpose of identifying an illegal copy of the 
digital image data by restoring the copyright or other identification information. 

In this regard, the Examiner's reliance on Yamadaji misses the point because the claimed 
inventions make use of watermarking of recorded parameters to invisibly embed such parameters 
into an image for purposes of digital image authentication and preventing alteration of such 
digital images, not protecting proprietary copyrights. Yamadaji's use of watermarking copyright 
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information into an image for purposes of identifying "unaltere d" illegal copies of a digital 
image is fundamentally distinct from the claimed use of watermark ing of recorded parameters for 
purposes of determining whether an image has been "altered" for purposes of digital image 
authentication. Thus, on a fundamental level, the Examiner failed to demonstrate how 
Yamadaii's teachings of watermarking for copyright protection would suggest to one of ordinary 
skill in the art the use of watermarking for image authentication. 

Furthermore, Examiner has failed to demonstrate how one of ordinary skill in the art 
would be motivated to combine Yamadaii's teachings of watermarking for copyright protection 
with Friedman's "recorded parameters" for purposes of image authentication. To begin, 
although Friedman discloses "recorded parameters", i.e., information (e.g., time or date) that can 
be captured in the border region of a photograph (see, e.g.. Fig. 4 of Friedman), Friedman does 
not disclose or even suggest the use of such "recorded parameters" specifically for purposes of 
image authentication. In particular, as explained above, Friedman provides image authentication 
using the well-known digital signature method by calculating a hash of an image file and 
comparing the calculated has with a secure image hash obtained by decrypting a corresponding 
digital signature. If the computed hash and secure image hash are the same, then the image is 
deemed authentic. 

As explained above, Friedman does not use recorded parameters, per se, for purposes of 
authentication, because the Friedman system can compute a hash of the image file and encrypt 
the image hash to generate the digital signature regardless of whether or not the image file has 
captured information in an image border region . In other words, to reiterate, although Friedman 
discloses a method for verifying the authenticity of an image and that certain parameters 
associated with a captured image may be recorded in an image border, the Friedman protocol 



17 



does not rely on such recorded parameters for authentication, i.e., Friedman does not explicitly 
use the recorded parameters to authenticate the image vis-a-vis the digital signature method. 

In contrast to Friedman , as explained above, the claimed inventions provide 
authentication bv watermarking Chiding^ captured image param eters into the image itself. 
With the claimed inventions, it is watermarked parameters that a re actuallv used for 
authentication and the captured image itself contains the information (watermarked parameters) 
for authenticating the image. Again, the Friedman authentication protocol (based on digital 
signature technology) can be used for authentication regardless of whether or not recorded 
parameters are contained in the border of the image file. 

Therefore, in view of Friedman's distinct teachings of a digital signature method for 

image authentication which is independent of "r ecorded parameters " and in view of Yamadaji's 

distinct teaching of watermarking copvrieht information timases or textual) in an image for 

purposes of copyright protection of the imase, it is clear that other than through impermissible 

hindsight reasoning fi-om Applicant's specification, the Examiner has failed to show that one of 

ordinary skill in the art would not be motivated to combine copvright wa termarking as taught by 

Yamadaii with the digital signature image authentication system of Friedman to derive an image 

authentication protocol based on watermarking of recorded parameters, as essentially claimed. 

Indeed, on a fiindamental level, neither Yamadaii nor Friedman disclose the use of embedded 

(watermarked) data in an image for authenticating the image. 

(b) The Combination of Friedman and Yamadaii Neither Discloses Nor 

Fairly Suggests Various Elements of Claims 1. 13 or 18 

Even assuming, arguendo, that the combination of Friedman and Yamadaii is deemed to 

be legally proper, it is respectfiiUy submitted that the combination of Friedman and Yamadaji is 

legally deficient to support a prima facie case of obviousness against claims 1, 13 or 18 because 
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at the very minimum, such combination does not disclose or fairly suggest, as a whole, the 
inventions of claims 1, 13 or 18, and in particular, such combination fails to disclose or suggest 
various elements of claims 1,13 and 18. 

For example, with regard to Claim 1, it is respectfully submitted that the combination of 
Friedman and Yamadaii does not disclose or suggest a system for capturing images, wherein the 
system comprises wireless communication means for receiving object data from objects in an 
observed image frame when the image is generated, wherein the object data comprises object 
identification information . Nor does such combination disclose or suggest information receiving 
means for receiving user data associated with a user of the system when the digital image is 
generated, wherein the user data comprises user identific ation information. 

As discussed in Section VI above, by way of example, Fig. 1 of Applicant's specification 
depicts an image capturing system (100) having a smart card reader (1 10), a Pan (Personal Area 
Network) receiver (122), an IR processor (1 18) or an RF processor (1 12), which can be used to 
obtain and record user data comprising user identification information such as the identity of the 
photographer (see, e.g.. Spec, page 9, lines 3-22). The IR processor (118) or RF processor (1 12) 
can be used for communicating with objects being photographed so as to obtain and record 
object data comprising object identification information such as the name and identity of the 
object being photographed (see, e.g., Spec, page 9, line 23, through page 10, line 6). These 
parameters, e.g., object data comprising object identification information such as the name and 
identity of the object being photographed (see, e.g., page 9, line 23, through page 10, line 6, of 
Applicants' specification). These parameters, e.g., object identification data and user 
identification data can be recorded with the digital image and watermarked into the image. 
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In the NEW ACTION, Examiner relies on Friedman as disclosing the above features of 
claim 1 . However, it is respectfully submitted that Examiner's reliance on Friedman in this 
regard is erroneous and glaringly misplaced because Friedman clearly does not disclose recorded 
parameters including (a) object identification information and (b) user identification information, 
as essentially claimed in Claim 1 . 

In particular, with regard to element (a) above. Examiner relies on Friedman's disclose of 
a range finder (13) (such as an acoustic, optical, laser or infrared) to capture range information of 
prominent objects in a scene (see, Friedman Col. 9, lines 42-46), essentially contending that the 
range information captured by the range finder (13) can be interpreted as object data that 
comprises object identification information (see, e.g., Pages 3-4 of the NEW ACTION). 
Although Friedman discloses a rangefinder to college "range information" to determine the 
distance an object is from the camera, the Examiner's strained interpretation of "range data" as 
being "object identification data" as contemplated by the claimed invention is an exercise of 
intellectual dishonesty, as there is simply no reasonable basis for construing such "range 
information" as being "object identification" as claimed in claim 1. Indeed, it is readily apparent 
that the "distance" of an object is to a camera is verv different from the "identity" of the object 
being imaged. 

Furthermore, with regard to element (b) above, Examiner relies on Friedman's disclosure 
(Col. 3, lines 1-1 1) of a "serial number" as being user data that comprises user identification 
information (see, e.g.. Page 4 of the NEW ACTION). Friedman discloses that each digital 
camera possess its own unique private/public key pair, wherein the public key can be placed on 
the camera 's name plate as a "serial number •• or recorded in the border region of an image file 
(see, e.g., Friedman Col. 7, lines 58-64). However, it is unreasonable to construe a camera 
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"serial number" as being ''user identification information " that is associated with the user of the 
imaging system when the digital image is captured by the user, as essentially claimed in Claim 1 . 
Indeed, in the Friedman system, the serial num b er (ox public key) is associated with the camera 
itself , and not with the user of the camera per se. In fact, many different users can use the same 
camera and in such instance, the "serial number" or public key would clearly not provide 
information regarding the identity of the person using the camera. 

Moreover, with respect to Claims 13 and 18, the combination of Friedman and Yamadaji 
does not disclose or suggest an authentication protocol that includes extracting parameters from 
a watermarked image using an associated verification key, comparing the extracted parameters 
with the original recorded/measured parameters associated with the captured image to 
determine if the extracted parameters match the originally recorded/measured parameters, as 
essentially claimed in claims 13 and 18. 

In fact, it should be noted that in the NEW ACTION, the Examiner provides no 
explanation of specific grounds to support of the rejection of Claims 13 and 18, other than 
reliance on same grounds of rejection of claim 1 (see, pages 3-5 of the NEW ACTION). In 
relying on the grounds for the rejection of claim 1, however, the Examiner has failed to address 
various elements of claims 13 and 18. For example. Examiner has not explained how the 
combination of Friedman and Yamadaji teaches or suggest authentication by, e.g., comparing 
watermarked parameters, which are extracted from a captured image, with the original 
parameters associated with the captured image, to determine if the extracted parameters match 
the original parameters, as essentially claimed in claims 13 and 18. In any event, as explained 
above, the combination of Friedman and Yamadaji does not teach watermarking parameters into 
an image for purposes of image authentication and, thus, it necessarily and logically follows that 
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such combination does not teach or suggest ''extracting watermarked parameters from the 
watermarked image and comparing the extracted parameters with the original parameters" to 
authenticate the image. 

Thus, for at least the above reasons, claims 1, 13 and 18 are believe to be patentable and 
non-obvious over the combination of Friedman and Yamadaji . Moreover, since claims 4-8, 12, 
14-17 and 19-22 depend from respective base claims 1, 13 or 18, these claims are patentable and 
nonobvious over the combination of Friedman and Yamadaii at least by virtue of their 
dependency. However, Appellants contend that at the very least, claims 4-6, 14, 19 and 21-22. 
are patentable over the combination of Friedman and Yamadaii in their own right. 

(2) Claim 6 is Not Obvious in View of Friedman an d Yamadaii 

With respect to claim 6, Examiner admits that neither Friedman nor Yamadaji expressly 
discloses the invention of Claim 6, but Examiner contends, in conclusory manner, that claim 6 
would have been obvious to one of ordinary to prevent the watermarking of an image if the 
quality of the image is altered above a threshold (as recited in claim 6) since "it would be a 
waste of time and money to watermark a damage/unclear image" (see. Pages 5-6 of the NEW 
ACTION). The impropriety of this rejection is glaringly apparent. 

In the first instance. Examiner's basis for obviousness misses the point, because the 
claimed invention contemplates preventing watermarking of the parameter into the image would 
affect the image quality, but not preventing watermarking of a damaged image as interpreted by 
Examiner. In any event, assuming Examiner's interpretation of Claim 6 to be proper, it is 
respectfully submitted that Examiner's grounds for obviousness in this regard is premised a bald, 
unsupported assertion based on Examiner's view of what would be obvious to one of ordinary 
skill in the art. 
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(3) Claims 4-5. 14 and 19 are Not Obvious in View of Friedman and Yamadaii 

Moreover, with respect to claims 4-5, 14 and 19, at least the reasons set forth above for 
claims 13 and 18, Examiner has provided no explanation as to how the combination of Friedman 
and Yamadaii teaches comparing the extracted parameters with the original recorded/measured 
parameters associated with the captured image. In particular, for each of claims 4, 5, 14 and 19, 
the Examiner's grounds for rejection is simply "see claim 1 above" (see, pages 5, 6 and 7 of the 
NEW ACTION). However, it is readily apparent that the grounds for rejection claim 1 are silent 
with respect to the claimed features of claims 4, 5, 14 and 19. Thus, the rejection is invalid on its 
face . 

(4) Claims 21 and 22 are Not Obvious in View of F riedman and Yamadaii 

Finally, with respect to claims 21 and 22, it is suffice to say that the Examiner's finding 

of obviousness is fundamentally flawed for at least the same reasons give above for Claim 1 . 

Indeed, at the very least, the Examiner has misconstrued Friedman as disclosing watermarked 

parameters that include object identification or user identification information. 

B. The Combination of Friedman . Y amadaii and Murphy is Legally Deficient to 
Support a Prima Facie Case of Obviousness A gainst Claim 9 

Claim 9 stand rejected as being unpatentable over Friedman , Yamadaii and Murphy, for 

the reasons set forth on pages 7-8 of the NEW ACTION. Rather than address this rejection, it is 

suffice to say that the obviousness rejection is invalid at least for the same reasons given above 

for Claim 1 . Indeed, because claim 9 incorporates the elements of Claim 1 by virtue of 

dependency, and since the rejection of Claim 1 is based on an improper finding of obviousness 

based on Friedman and Yamadaii , the NEW ACTION fails at the very least to demonstrate how 

the combined teachings of Friedman , Y amadaii and Murphy meet the elements of Claim 9. 
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C. The Combination of Friedman , Y amadaii and Tanaka is Legally Deficient to 
Support a Prima Facie Case of Obviousness Against Claim 9 

Claims 10 and 1 1 stand rejected as being unpatentable over Friedman . Yamadaji and 
Tanaka , for the reasons set forth on pages 8-9 of the NEW ACTION. Rather than address this 
rejection, it is suffice to say that the obviousness rejection is invalid at least for the same reasons 
given above for Claim 1. Indeed, because Claims 10 and 11 incorporate the elements of Claim 1 
by virtue of dependency, and since the rejection of Claim 1 is based on an improper finding of 
obviousness based on Friedman and Yamadaii . the NEW ACTION fails at the very least to 
demonstrate how the combined teachings of Friedman . Y amadaii and Tanaka meet the elements 
of Claims 10 and 11. 

D. CONCLUSION 

Accordingly, for at least the above reasons, it is respectfully requested that the Board 
reverse all claim rejections under 35. U.S.C. § 103 (a). 
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Claims Appendix 

1 . An image capturing system for automatically recording and watermarking a plurality 
of parameters in a captured image, comprising: 

a central processing unit for controlling a plurality of functions and operations of said 

system; 

image capture means, operatively connected to said central processing imit, for 
generating a digital image of an observed image frame and for generating a plurality of image 
data associated with said generation of said image; 

wireless communication means, operatively connected to said central processing unit, for 
receiving object data from objects in said observed image frame when said image is generated, 
said object data comprising object identification information; 

geographic location determining means, operatively connected to said central processing 
unit, for determining geographic coordinates of said system when said digital image is generated; 

means for determining a time and a date when said image is generated; 

information receiving means, operatively coupled to said central processing unit, for 
receiving user data associated with a user of said system when said digital image is generated, 
said user data comprising user identification information; 

image processing means for receiving said plurality of parameters and recording said 
plurality of parameters with said generated digital image, said plurality of parameters including 
said plurality of image data, said object data, said time data, said date data, said location data, 

and said user data; and 

means, operatively coupled to said image processing means, for watermarking said 

plurality of parameters into said image. 
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2. The system of claim 1, further comprising means for specifying which of the plurality 
of parameters should be recorded with said image and for specifying which of said plurality of 
parameters should be watermarked in said image. 

3. The system of claim 2, further comprising means for determining which of the 
plurality of parameters are specified to be recorded with said image and for determining which of 
the plurality of parameters are specified to be watermarked in said image. 

4. The system of claim 1 , further comprising means for extracting said watermarked 
parameters from said watermarked image. 

5. The system of claim 4, further comprising means for comparing said extracted 
parameters with corresponding recorded parameters of said image to authenticate said image. 

6. The system of claim 1 , further comprising means for preventing said watermarking of 
said images if an image quality of said image is altered above a threshold. 

7. The system of claim 1, further comprising image compression means, operatively 
coupled to said image processing means, for compressing said image. 

8. The system of claim 7, wherein said plurality of parameters are watermarked in one of 
said compressed image and said image. 
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9. The system of claim 1, further comprising orientation determining means, operatively 
coupled to said central processing unit, for determining orientation data of said system when said 
digital image is generated; said orientation data being one of said plurality of parameters. 

10. The system of claim 1, further comprising 

means for receiving one of verbal data and verbal commands; and 
means for processing said one of received verbal data and received verbal command, said 
processed verbal commands being used to control one of a plurality of function and operations of 
said system, said processed speech data being one of said plurality of parameters for annotating 
said digital image. 

11. The system of claim 1, further comprising means for determining said location of 
said system when said geographic location determining means is inoperable. 

12. The system of claim 1, wherein said plurality of image data associated with said 
generation of said image includes one of an image mode, image quality, exposure duration, 
aperture length, light meter reading, flash status, lens focal length, auto focus distance, frame 
number, and a combination thereof 

13. In an image capturing system, a method for authenticating a captured image, 

comprising the steps of: 

measuring a plurality of parameters associated with said captured image; 
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watermarking said plurality of parameters into said captured image to generate a 
watermarked image, and generating a verification key associated with said watermarked 
parameters; 

extracting said plurality of parameters from said watermarked image with said associated 
verification key; and 

comparing said extracted plurality of parameters from said watermarked image with said 
measured plurality of parameters associated with said captured image, whereby said captured 
image is authenticated if said extracted parameters match with said measured parameters. 

14. The method of claim 13, further comprising the step of recording said measured 
plurality of parameters associated with each captured image, said extracted parameters being 
compared with said recorded parameters to authenticate said captured image. 

15. The method of claim 14, further comprising the step of specifying which of said 
measured plurality of parameters is to be watermarked into a corresponding captured image. 

16. The method of claim 14, further including the step of transmitting said watermarked 
image and said associated verification key to a remote system, and said extracting step and said 
comparing step are performed in said remote system. 

17. The method of claim 14, further comprising the step of compressing said captured 
image prior to said watermarking step, whereby said measured parameters are watermarked into 
said compressed image. 
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18. A method for verifying the authenticity of a captured image, said captured image 
being generated by an image capturing system having means for measuring a plurality of 
parameters associated with said captured image and means for watermarking said plurality of 
parameters within said captured image, said method comprising the steps of: 

specifying at least one of said plurality of parameters to be measured and watermarked by 
said image capturing system; 

capturing an image of a desired object with said image capturing system; 

watermarking said captured image of said object with said specified parameters; 

generating a corresponding verification key based on said watermarked parameters; 

storing said watermarked image and said corresponding verification key; 

retrieving said watermarked image and said corresponding verification key; 

extracting from said watermarked image said watermarked parameters using said 
verification key; 

comparing said extracted parameters with said specified parameters to determine if said 
extracted parameters match said specified parameters. 

19. The method of claim 18, further comprising the step of recording said specified 
parameters, wherein said recorded parameters are compared with said extracted parameters. 

20. The method of claim 19, wherein said step of recording said specified parameters 
includes one of electronically recording said specified parameters with said captured image and 
manually recording said specified parameters associated with said captured image. 
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21. The method of claim 13, wherein the step of measuring a plurality of parameters 
associated with said captured image comprises receiving and recording object data from an 
object in an observed image frame when the image is generated, said object data comprising 
object identification information. 

22. The method of claim 18, wherein said plurality of parameters to be measured and 
watermarked comprises user data that is automatically transmitted from a user and recorded 
when said image is captured, said user data comprising user identification information. 
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Evidence Appendix 

There is no evidence submitted pursuant to 37 CFR § § 1 . 1 30, 1 . 1 3 1 or 1 . 1 32 or any other 
evidence entered by the examiner and relied upon by appellant in this Appeal. 
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Related Proceedings Appendix 

None. 



